Assessing heterogeneity of electronic health-care databases: A case study of background incidence rates of venous thromboembolism.

PURPOSE: Heterogeneous results from multi-database studies have been observed, for example, in the context of generating background incidence rates (IRs) for adverse events of special interest for SARS-CoV-2 vaccines. In this study, we aimed to explore different between-database sources of heterogeneity influencing the estimated background IR of venous thromboembolism (VTE). METHODS: Through forest plots and random-effects models, we performed a qualitative and quantitative assessment of heterogeneity of VTE background IR derived from 11 databases from 6 European countries, using age and gender stratified background IR for the years 2017-2019 estimated in two studies. Sensitivity analyses were performed to assess the impact of selection criteria on the variability of the reported IR. RESULTS: A total of 54 257 284 subjects were included in this study. Age-gender pooled VTE IR varied from 5 to 421/100 000 person-years and IR increased with increasing age for both genders. Wide confidence intervals (CIs) demonstrated considerable within-data-source heterogeneity. Selecting databases with similar characteristics had only a minor impact on the variability as shown in forest plots and the magnitude of the I2 statistic, which remained large. Solely including databases with primary care and hospital data resulted in a noticeable decrease in heterogeneity. CONCLUSIONS: Large variability in IR between data sources and within age group and gender strata warrants the need for stratification and limits the feasibility of a meaningful pooled estimate. A more detailed knowledge of the data characteristics, operationalisation of case definitions and cohort population might support an informed choice of the adequate databases to calculate reliable estimates.

Safety Monitoring of COVID-19 Vaccines: Perspective from the European Medicines Agency.

Prior to deployment of coronavirus disease 2019 (COVID-19) vaccines in the European Union in 2021, a high vaccine uptake leading to an unprecedented volume of safety data from spontaneous reports and real-world evidence, was anticipated. The European Medicines Agency (EMA) implemented specific activities to ensure enhanced monitoring of emerging vaccine safety information, including intensive monitoring of reports of adverse events of special interest and the use of observed-to-expected analyses. The EMA also commissioned several independent observational studies using a large network of electronic healthcare databases and primary data collection via mobile and web-based applications. This preparedness was key for two high-profile safety signals: thrombosis with thrombocytopenia syndrome (TTS), a new clinical entity associated with adenovirus-vectored vaccines, and myocarditis/pericarditis with messenger RNA vaccines. With no existing case definition nor background rates, the signal of TTS posed particular challenges. Nevertheless, it was rapidly identified, evaluated, contextualized and the risk minimized thanks to close surveillance and an efficient use of available evidence, clinical expertise and flexible regulatory tools. The two signals illustrated the complementarity between spontaneous and real-world data, the former enabling rapid risk identification and communication, the latter enabling further characterization. The COVID-19 pandemic has tremendously enhanced the development of tools and methods to harness the unprecedented volume of safety data generated for the vaccines. Areas for further improvement include the need for better and harmonized data collection across Member States (e.g., stratified vaccine exposure) to support signal evaluation in all population groups, risk contextualization, and safety communication.

Comparative risk of thrombosis with thrombocytopenia syndrome or thromboembolic events associated with different covid-19 vaccines: international network cohort study from five European countries and the US.

OBJECTIVE: To quantify the comparative risk of thrombosis with thrombocytopenia syndrome or thromboembolic events associated with use of adenovirus based covid-19 vaccines versus mRNA based covid-19 vaccines. DESIGN: International network cohort study. SETTING: Routinely collected health data from contributing datasets in France, Germany, the Netherlands, Spain, the UK, and the US. PARTICIPANTS: Adults (age ≥18 years) registered at any contributing database and who received at least one dose of a covid-19 vaccine (ChAdOx1-S (Oxford-AstraZeneca), BNT162b2 (Pfizer-BioNTech), mRNA-1273 (Moderna), or Ad26.COV2.S (Janssen/Johnson & Johnson)), from December 2020 to mid-2021. MAIN OUTCOME MEASURES: Thrombosis with thrombocytopenia syndrome or venous or arterial thromboembolic events within the 28 days after covid-19 vaccination. Incidence rate ratios were estimated after propensity scores matching and were calibrated using negative control outcomes. Estimates specific to the database were pooled by use of random effects meta-analyses. RESULTS: Overall, 1 332 719 of 3 829 822 first dose ChAdOx1-S recipients were matched to 2 124 339 of 2 149 679 BNT162b2 recipients from Germany and the UK. Additionally, 762 517 of 772 678 people receiving Ad26.COV2.S were matched to 2 851 976 of 7 606 693 receiving BNT162b2 in Germany, Spain, and the US. All 628 164 Ad26.COV2.S recipients from the US were matched to 2 230 157 of 3 923 371 mRNA-1273 recipients. A total of 862 thrombocytopenia events were observed in the matched first dose ChAdOx1-S recipients from Germany and the UK, and 520 events after a first dose of BNT162b2. Comparing ChAdOx1-S with a first dose of BNT162b2 revealed an increased risk of thrombocytopenia (pooled calibrated incidence rate ratio 1.33 (95% confidence interval 1.18 to 1.50) and calibrated incidence rate difference of 1.18 (0.57 to 1.8) per 1000 person years). Additionally, a pooled calibrated incidence rate ratio of 2.26 (0.93 to 5.52) for venous thrombosis with thrombocytopenia syndrome was seen with Ad26.COV2.S compared with BNT162b2. CONCLUSIONS: In this multinational study, a pooled 30% increased risk of thrombocytopenia after a first dose of the ChAdOx1-S vaccine was observed, as was a trend towards an increased risk of venous thrombosis with thrombocytopenia syndrome after Ad26.COV2.S compared with BNT162b2. Although rare, the observed risks after adenovirus based vaccines should be considered when planning further immunisation campaigns and future vaccine development.

Suitability of databases in the Asia-Pacific for collaborative monitoring of vaccine safety.

INTRODUCTION: Information regarding availability of electronic healthcare databases in the Asia-Pacific region is critical for planning vaccine safety assessments particularly, as COVID-19 vaccines are introduced. This study aimed to identify data sources in the region, potentially suitable for vaccine safety surveillance. This manuscript is endorsed by the International Society for Pharmacoepidemiology (ISPE). METHODS: Nineteen countries targeted for database reporting were identified using published country lists and review articles. Surveillance capacity was assessed using two surveys: a 9-item introductory survey and a 51-item full survey. Survey questions related to database characteristics, covariate and health outcome variables, vaccine exposure characteristics, access and governance, and dataset linkage capability. Other questions collated research/regulatory applications of the data and local publications detailing database use for research. RESULTS: Eleven databases containing vaccine-specific information were identified across 8 countries. Databases were largely national in coverage (8/11, 73%), encompassed all ages (9/11, 82%) with population size from 1.4 to 52 million persons. Vaccine exposure information varied particularly for standardized vaccine codes (5/11, 46%), brand (7/11, 64%) and manufacturer (5/11, 46%). Outcome data were integrated with vaccine data in 6 (55%) databases and available via linkage in 5 (46%) databases. Data approval processes varied, impacting on timeliness of data access. CONCLUSIONS: Variation in vaccine data availability, complexities in data access including, governance and data release approval procedures, together with requirement for data linkage for outcome information, all contribute to the challenges in building a distributed network for vaccine safety assessment in the Asia-Pacific and globally. Common data models (CDMs) may help expedite vaccine safety research across the region.